DOCUMENT RESUME 



ED 454 826 



IR 020 805 



TITLE 

PUB DATE 
NOTE 



PUB TYPE 

EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



ICCE/ICCAI 2000 Full & Short Papers (Intelligent Tutoring 
Systems) . 

2000 - 11-00 

2 02p . ; In: Learning Societies in the New Millennium: 
Creativity, Caring & Commitments. International Conference 
on Computers in Education/International Conference on 
Computer-Assisted Instruction (Taipei, Taiwan, November 
21-24, 2000); see IR 020 792. Some figures contain very 
small and illegible type. 

Collected Works - General (020) -- Speeches/Meeting Papers 

(150) 

MF01/PC09 Plus Postage. 

*Educational Technology; Elementary Secondary Education; 

* Intelligent Tutoring Systems; Internet; Post secondary 

Education; Programmed Tutoring 

Learning Environments; *Web Based Instruction 



ABSTRACT 



This document contains the full and short papers on 
intelligent tutoring systems (ITS) from ICCE/ICCAI 2000 (International 
Conference on Computers in Education/International Conference on 
Computer-Assisted Instruction) covering the following topics: a framework for 
Internet-based distributed learning; a fuzzy-based assessment for the Perl 
tutoring system, a learning environment for problem posing in simple 
arithmetical word problems; a method of creating counterexamples by using 
error-based simulation; adaptive programming language tutoring system on the 
World Wide Web; an agent -based collaborative learning environment for ITS; an 
agent-based ITS; an educational system that can visualize the behavior of 
programs on the domain world; an environment for learning by design in the 
case of learning of search algorithms; an online ITS for elementary algebra; 
automatic background knowledge construction using genetic algorithms; AWETS 
(Automatic Web-Based English Testing System) ; case-based evaluating assistant 
of novice program; CBR-Tutor--a case-based reasoning approach to an Internet 
agent-based tutoring system; controlling problem progression in adaptive 
testing; development of an intelligent learning support system with a large 
knowledge base; educational agents and the social construction of knowledge; 
generating interactive explanations by using both images and texts for Micro 
World; intelligent interactive learning environment design issues; towards a 
meta- knowledge agent- -creating the context for thoughtful instructional 
systems; modeling the tutor using reinforcement learning; monitoring and 
verifying mathematical proofs formulated in a restricted natural language; a 
multimedia ITS for context-free grammar; MyEnglishTeacher- -a Web system for 
academic English teaching; navigation script for the Web; organization of the 
introductory and motivating stage of activity in a computer tutoring system; 
the application of uncertainty reasoning for an ITS; the design and 
implementation of an automatic exercise generator with tagged documents based 
on the intelligence of students (AEGIS); traversing the case graphs: a 
computer model for developing case-based learning systems; use of abstraction 
levels in the design of ITS; and using decision networks for adaptive 
tutoring. (MES) 
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Communication technology as well as the communication infrastructure are both 
changing rapidly. As a consequence, systems that support web-based learning 
need to be adapted due to changes in technology. This paper describes a model 
for web-based learning with intelligent tutoring systems (ITS) that allows 
separation of the concrete communication from the ITSs’ implementation. The 
resulting framework provides a technical solution to distribute any ITS over a 
network. The ITS SYPROS is used to illustrate how a classical ITS can be 
extended to a web-based tutoring system with a maximum of code-reuse. The 
framework may be used freely with any ITS. To accommodate the needs of 
various ITSs, our model supports several architectures for distributed adaptive 
tutoring, including the three different models described in [3]: Master-Slave, 
Communicating Peers and Centralized Architectures. Our main goals are: 

• • Make the ITS usable for a wide range of users by supporting any web 
browser on any operating system.* ‘Offer a simple, extendable and platform 
independent framework to ease web-based tutoring. • • Provide a solution 
without royalties.* -Separate the communication technology from the client and 
server implementation. • -Enable method invocation and parameter passing 
semantics over the HTTP protocol to virtually support any web browser and 
users behind firewalls. • -Offer an simple user accounting and user 
communication functionality.- -Provide a wrapper to connect to an existing ITS. 

The Java source code is freely available: http://www.in.tum.de/~herzog/sypros. 

Keywords: Web-Based Learning, System Design and Development, 

Intelligent Tutoring Systems 



1 Introduction 

Classical intelligent tutoring systems (ITS) are often platform dependant and not distributed. Modem, 
distributed intelligent tutoring systems (DITS) provide a more attractive solution with respect to usability 
and platform independence. Therefore, a modem distributed infrastructure like the internet with 
communication techniques like CORBA or RMI is suitable. A stable, safe and extendable basis for 
communication and cooperative work is needed. However, technology in this area is rapidly changing on the 
one hand. On the other hand communication technologies like CORBA or RMI are (still) not usable with 
every client, browser or platform and still have several drawbacks which prevent their usability at least for 
some users: Macintosh users and users with old browsers or behind firewalls/proxies who also want to use 
secure socket factories, only to name some. 

This paper di scribes a model and the resulting framework to overcome such problems. We propose to 
address these problems by providing an API with the semantics of object oriented remote method calls over 
HTTP and Servlets. Further functionality that is most likely in common for any DITS (such as user 
accounting and identification, security and administrative functionality) is implemented and encapsulated for 
ease of use. 

In the current version, SYPROS is an ITS in the domain of the synchronization of parallel processes with 
semaphores [4], a domain of programming problems. 
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All the typical modules of an ITS [15] like the expert module with different types of cooperating domain 
experts [13], the instructional module with different tutoring strategies, the student model with cognitive and 
motivational traits [12], and the interface module with several support facilities, are fully implemented in 
SYPROS. 

The current version system is a classical ITS for single-user mode and is written in C for UNIX systems. 
The user interface is based on the X Windows system and therefore the ITS is platform dependent. There is 
no direct support for multiple clients and no accounting, access control or WWW support as it would be 
needed for a web-based group learning system, which is our ultimate goal [11]. In the current 
implementation the user interface is divided at function level from the 'intelligence' and database 
functionality, but is linked to one single executable. The proposed model will provide an application 
interface (API) for the client and server side. The API will encapsulate various ways of communication over 
a network using an abstract factory pattern [2,10]. Concrete implementations for Java RMI and servlets are 
provided. This model is designed to be easily extendable by other means of network transportation (e.g., 
CORBA or even Sockets). It will include conceptional security at an eligible level. Further, various ways of 
interfacing to an existing ITS on the server side are given (Java native calls to C/C++ and the connectivity to 
shell scripts). This factory can also be easily extended. Figure 1 shows the distribution of SYPROS. The 
servlet proxy Server enables connection for old webbrowsers, running not necessarily on the same machine 
as the SyprosServer implementation. Two clients are connected: “Old Webbrowser” connects using the 
servlet proxy, “New Webbrowser” can either use servlet communication or RMI[17]/ CORBA[22] (or 
anything else). 

This work covers two more aspects: a security discussion for the provided model with a special focus on 
security issues for an ITS and a usability discussion for various platforms and webbrowsers. 




Figure 1 . Distribution of client, server and servlet proxy in SYPROS (UML[19]). 



Figure 2 shows the different layers for communication and levels of abstraction for a client initiated request. 
The dotted line between the implementation (application) level and the abstraction denotes that both the 
client and server implementation are separated from the underlying concrete communication. This model 
provides transparency in terms of process transparency. (That is, the machine on which the function or 
method is executed isn't known to the client's application level.) This can be compared to remote procedure 
calls (RPC) where the client stub and the server skeleton provide a similar transparency. In addition to that, 
our framework separates the concrete communication (the lowest layer in figure 2) from the application 
layer using the abstract communication layer. This provides transparency regarding the concrete 
communication technology used and therefore unburdens the application programmer from changing the 
application to support new technologies. 

For some concrete communication implementations our framework supports language transparency as far as 
the client's implementation language may differ from the server's (e.g., for CORBA or Servlets). 
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Figure 2. Levels of abstraction and layers for a request initiated by the client (UML deployment diagram). 



2 Requirements 

All base functionality for a distributed system is implemented. Remote method invocations are implemented 
independently from the Java RMI package over a ComOb ject which is JDK 1.1 [9] compliant. User 
accounting, login procedures and access control as well as connection state information is supported directly 
in the framework. 

A wrapper is provided to connect to an existing ITS over Java Native Interface (JNI[14J) or shell script 
invocation. 
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Figure 3. Some interactions among actors and use cases in SYPROS (UML use case diagram). 

The use case diagram in figure 3 shows some of the use cases for SYPROS. Four types of human actors are 
shown in their interaction with the use cases. “Student” denotes an actor who is already known to the 
system. Therefore, “Student” logs into the server by passing the ’’Login” use case. “Login” performs 
authentication for which it <<uses>> the “Validate User” use case, which has knowledge of all valid 
user entries and so on. After accepting the user's login request some state information for that connection 
will be stored “Add Active User” and a UserTicket object is returned to allow stateful and secure client 
interaction. (UserTicket might be encrypted.) 

“New Student” is an actor who is not known to the system. (Guests are handled identically.) Therefore, she 
can create a new user database entry herself (“Add User”). Later, the gathered information will be used to 
log into the system as described before. 

An active user (“Student”) might also use other services on the ITS server side. For example, the “Work on 
Exercise” use case first validates the call against the active users database and then uses “Counect ITS” 
(which interfaces the ITS using the wrapper) to work with the tutoring system. 

“Tutor” is a human actor who might use the “Configure Exercise?’ use case to set up some exercises or 
check the student's results. The differing permissions (compared to a student) are handled by the “Validate 
User” use case. 




An “Administrator” user will not use the client interface to connect to the server in this model. The 
administrator configures the databases and configuration files. Therefore, “Administrate” extends 
“Validate User”. 

Resulting from the requirements given before our model and the framework should further satisfy the 
following nonfunctional requirements, pseudo requirements and design goals: The server-side installation 
should be simple and conceptionally platform independent. It should not be addicted to any specific web 
server and should work with freely available products such as Apache. 

The framework is designed to be fully platform independent using the Java programming language. 
However, some platform dependencies exist from possible webbrowser incompatibilities and the existing 
ITS. In order to support old webbrowsers or users behind a firewall or proxy, a servlet repository which acts 
as a proxy and a servlet based client communication is provided. The communication implementation may 
be switched online in the client implementation 1 . 

The SYPROS system can be used by four groups of people: students, guests (users who are not known to the 
system by now), tutors and administrators (tutors who fulfill administrative functions). Therefore, the 
framework supports users at different level of permissions (similar to e.g., UNIX or WindowsNT). 

The client applet should be small so that it is suitable even for slow modem connections. The classes needed 
for communication on the client side are less than 20 KB in size (without JCE security). Once the Applet is 
loaded, the response time of the user interface is short, as it is running locally on the client side. 

The response time resulting from the security key generation and secret key exchange (Diffie -Heilman for 
example) of the Java Cryptography Extension (JCE) is rather long especially for strong keys and due to 
JCE's implementation in Java (see discussion in section 4). 

Performance of the network communication depends on the underlying infrastructure. With most browsers, 
servlets will have a more overhead than CORBA or RMI. 

The communication framework aims to support three possible client-server bindings: Static (the server name 
is stored in the client application), semi-static (the client locates the server once, e.g., at login time) and 
dynamic (the client looks up the server each time it needs to connect). Client server binding uses name 
resolution to find a suitable ITS server in the network. The toolkituses a server string such as “II [hostname] 
ip-address}! [service-name }” , just like RMI for either underlying communication infrastructure. At client 
implementation level, the programmer may decide whether to use static, semi -static or dynamic binding. 

Together with the way of client-server binding, stateless and stateful client server connections using tickets 
are possible. User tickets are invented as "high-level“ stateful client-server connection for two reasons: first, 
the underlying ITS needs to know about the caller; tickets provide an easy way to identify the caller during a 
learning session. Second, encrypted ticket objects can be used to prevent attacks by intercept and replaying 
messages (see section 4). 

Calling a remote function is somewhat dangerous if the programming language used supports call-by- 
reference 2 . For Java, call-by-reference is replaced by a call-by-copy/restore semantics. (See Java 
RemoteObject for RMI). A call-by-copy/restore semantics can be simulated for servlets using the 
EventListener model. In that case, the servlet proxy uses a RemoteObject for the server 
communication if the communication between the servlet proxy and the server is based on RMI and returns 
the object to the client using the event model. This may also be encapsulated in the framework. 

In case of middleware communication such as CORBA/ RMI the call-by-copy/restore semantics can directly 
rely on the appropriate native semantics. The framework supports synchronous method invocations. 
Asynchronous calls can be realized using call-by -copy/ restore. 



1 This feature should be omitted for maximum compatibility with old browsers and Java engines (JDK level 

1 . 1 ). 

2 Function calls that use call-by-reference parameter passing deliver a pointer to the value or data the 
parameter stores. In a distributed system with different address spaces this triggers side-effects[20]. 



Java's try- catch-statements are used for error handling. Therefore, the framework's error semantics is 
at-most-once by default. At application level, return values might be used to signal unexpected behavior. 
The SYPROS login ( ) -Method for example returns null for the UserTicket if the server can't accept 
the login request. Although there are several possible reasons for that (e.g., unknown user, wrong password) 
their origin is not a communication error. 

The resulting framework is described using UML notation for scenarios, use cases and object models[2,19]. 
The API description is given in standard Java notation[9]. The use of our framework is illustrated by the 
SYPROS sample. 

3 A Model for the Communication Framework 

Figure 4 shows the UML diagram for the SYPROS server implementation using the communication 
framework. The diagram shows two possible extensions for SyprosServer: ComCORBA and ComRMI. In 
the real world implementation the programmer has to decide either to use CORBA or RMI, as Java does not 
allow multiple class inheritance. 




Figure 4. SYPROS server implementation. Class attributes and methods are omitted. (UML class diagram) 



Therefore, there are some specialties in the server implementation: depending on the selected 
communication technology, the programmer has to change the head of the class definition to extend the right 
Comint erf ace. Further, the server has to implement the Sypros interface which defines the exported 
functions (for the RMI case). SyprosClientlnterf ace contains the same definitions like Sypros but 
doesn't depend on the Java RMI classes. This ensures usability for old webbrowsers (with old Java virtual 
machines, VM) or clients that don’t support RMI for other reasons (Macintosh). 



import sypros .util . * ; 
import sypros .com. util . *; 
import sypros . com. server . ComRMI ; 

public class SyprosServer extends} ComRMI implements Sypros { 

public SyprosServer (String hostName, String servtfame) throws RemoteException 

{ 

super (serverHost, servName) ; // create bindings 

} 

public static void main(String args [] ) { 

setSecurity () ; // setup default security 

} 

} 

Figure 5. Client applet implementation for the SYPROS sample. 
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Figure 5 shows the class definition for the SYPROS server implementation using RMI. The underlined 
statements would have to be changed for a different type of communication technology. 

The client implementation allows dynamic switching of the communication technology. Figure 6 shows the 
UML class diagram for the SYPROS client Applet. As the client communication model uses an abstract 
factory pattern [2,19] to create the appropriate concrete communication, the client might be a Java Applet or 
a Java standalone application. (The server could also be connected using the servlet URLs from HTML or 
other languages.) 




Figure 6. Client applet implementation for the SYPROS sample (UML class diagram). 

The classes in the client model can be seen in three categories. First of all, SyprosApplet is the 
implementation for the SYPROS client interface. (Plus Applet, the parent.) As described before, the 
implementation needs not to be changed for changing communication technologies. 

Then the communication classes themselves: ComFactory, ComObject and their concrete 
implementations provide the application interface for the implementation. Servlet Connect ion is a 
helper that provides a per-servlet connection for persistent calls in a multithreaded application. 

The Abstract ComAdmin and its concrete implementations for servlets and RMI currently realize 
notification for server to client messages using the Event Listener model and can be used for call-by- 
copy/restore type parameter passing. 



4 Conceptual Security 

Any internet-based application requires a special focus on security issues. The history of designing secure 
systems, however, teaches the inadequacy of enhancing existing systems with additional security 
functionality [8]. To integrate the security functionality for secure web-based tutoring, we included security 
policies in the framework with a top-down approach. We start by specifying the security requirements as 
part of the security policy: 



Authentification: 

Total access control: 
Non repudiation: 
Communication privacy: 
Availability: 



All subjects and objects of the system have to be authentificated. 
Every access to protected units has to be supervised. 

Every action performed by a subject can be assigned to it's originator. 
Dataflow over unsafe networks has to be adequately encrypted. 
Denial-of-Service attacks should be identified. 



To meet the authentification, total access control and no-denial requirements, the framework offers 
integrated functionality that can be adapted or extended to your application needs. Communication privacy 
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is provided using encrypted transmission (encrypted object serialization) based on the Java Cryptography 
Extension (JCE). JCE offers secret key agreement protocols (e.g., Diffie-Hellman) and encryption (e.g., 
Blowfish) with variable key lengths. 

Ensuring the availability of a web-based service against denial-of-service attacks is maybe the hardest task. 
The Servlet-Proxy allows load-balancing, where the typical communication load of an ITS application (little 
amounts of data, long periods of thinking, infrequent transmissions) can be used to identify attacks. s 



5 Conclusions and Outlook 

Our framework offers an easy and extendable basis for web-based distributed tutoring. The communication 
technology, security and ITS-integration can be easily adapted to the specific needs of an existing ITS as 
well as to changing communication or security technologies without rewriting the implementation for the 
ITS clients or server. 

User accounting and access rights deliver the basis to support groups of students. However, support for 
cooperative work should be included in the ITS itself, like for example in SYPROS. 
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In this paper, we present a fuzzy -based assessment for Perl Tutoring system. The 
Perl Tutor is implemented in a multi-domain framework so that it can teach 
target domain knowledge by giving supporting knowledge to reinforce the 
learning. In order to assess supporting knowledge, an assessment is performed 
before the tutoring begins. Its main purpose is to test student’s previous 
declarative knowledge of computer programming. At the end of it, a directed 
tutoring graph will be generated to optimize the tutoring process. 

Keywords: fuzzy rule, assessment, student modeling, multi -domain tutoring 



1 Introduction 

There exist many works on optimized assessment process concerned with the efficiency of testing and its 
completeness. Granularity , prerequisite relationships , Bayesian propagation and neighborhood of 
knowledge states are some of the successful attempts employed to increase the efficiency of testing 
[2,5,6,13,17]. Yet, even though they could increase the efficiency significantly, they still have too many 
burdens given the large knowledge spaces. Fortunately, not all the student models need to be precise to be 
useful [10]. To ease the burden to student modeling, a fuzzy approach has been used and has so far worked 
quite well [3,10,1 1]. 

The purpose of this paper is to present the fuzzy approach in the assessment of student’ s knowledge in the 
Perl Tutoring System [16], which teach programming language (Perl) by reinforcement from other 
supporting languages (C++ and/or Java). For the effectiveness of reinforcement, the system should quickly 
evaluate the student’s knowledge of supporting languages. But the assessment needs not to be in high 
precision. Other works related to student modeling almost put their emphasis on the adaptive assessment 
during tutoring [14,15,17]. Yet due to the nature of our Perl tutor, we apply an assessment module before 
tutoring begins and it consists of two parts: questionnaire and testing. During the questionnaire part, students 
are asked to self-assess their knowledge by filling out a form provided by the system. In order to evaluate 
their statements, a testing part is given based on those statements. At the end of the assessment, the tutor will 
have a general picture of students’ prior knowledge of supporting languages: with which part they are 
familiar etc. Since the goal of the assessment is only to get a rough knowledge states for supporting purpose, 
it should not take too long to complete. Thus, a coarse granularity with imprecise mastery level is 
appropriate. 

In the next part of this paper, we briefly discuss the Perl tutoring system followed by the fuzzy logic. Then 
we will describe the questionnaire part and the testing part and end with discussion. 



1 The work related to this paper is funded under the Hong Kong Polytechnic University research grant No. 
PoIyU5072/98E. 
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2 Overview of the Perl Tutoring System 



Figure 1 illustrates the directed tutoring graph in the system [16]. The three pieces of knowledge items 
presented to students are: data type, logical operators and control structures. In the figure, 

• Each vertex represents a sub-domain; 

• Each pair of the sub-domain may be connected with a unidirectional or bi-directional arc. 

• Each arc represents the relationship between two sub-domains. 

Moreover, each sub-domain may consist of several vertices, which are the sub-sub -knowledge items of their 
parent domain. For example, under * data type’ , we also have * integer’ , * float’ , * boolean’ etc. 
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Figure 1 A Digraph of the Perl Tutoring System 

C++ [1] and Java share many similarities with Perl, although they, of course, have their own features. See 
Table 1 for a comparison. 
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CDR terms 
(General) 


Knowledge piece in 
PERL 


Knowledge 
piece in C++ 


Knowledge 
piece in Java 




Numeric operators 


+,-,*,/, %, ** 




%. 




Relational operators 


<,<=,>,>=, <=>(for 
numeric ) 
lt,le,gt,ge,cmp(for 
string) 


<,<=,>,>= 


<,<=,>,>= 




Equality operators 


-,!=(for numeric) 
eq,ne(for string) 


.^J 


=,!= 




Logical operators(binary) 


&&,i 


&&,|| 


&&,|| 




Logical operators(unary) 


\ 9 


i . 


! r 




Bit manipulation operators 


&, i, a .~ 


&, i, a ,~ 


&,i, a ,~ 




Bit shift operators 


«,» 


«, » 


«,»,»> 


Operators 


Auto-increment & auto- 
decrement operators 


++,-- 


++,~ 


++,- 


Speical 

operators 


Conditional 

operators 


?: 


?: 


?: 








Other operators 


*,x(string operators) 


Sizeof 


Instanceof 










>,\(dereference/ref 
erence operator 








Multiple operators 




+=, -=, *=, /=. 
%=, &=, i=, 
«=, »=, 
++=,-= 


+=, -=, *=, 
/= %=, &=, 

|=, «=, »=, 
»>= ++= — 


Control structures 




If, if/else, 
unless/else, 

While, do/while, for, 
continue, goto 

Notes:labled loops 
can be used within 
for, while, or do 


If, if/else, 

while, 

do/while, for, 
continue, goto, 
switch, break 


if, if/else, 

while, 

do/while, for, 
continue, 
break, switch 

Notes:labled 
loops can be 
used within 
for, while, or 
do 






Special structures 


Foreach 

Redo 


Exit 





Table 1 Similarities and differences in C++, Java and Perl 

CDR represents * cross -domain reference’ which serves as a dictionary for the domains. It is composed of 
basic terms used across the computer language regardless of which language is being referred. If the student 
has learned computer language before, he will develop a clear picture of the terms or concepts used, which 
serves as a guide for the learning of Perl. Besides, he will also integrate his former learning into his current. 
Through this knowledge transfers, the time spent on learning Perl will be greatly reduced [8]. 

Before tutoring begins, a weight is assigned to every direction of arc that represents the easiness of the 
acquisition of one sub-domain (target) after acquiring another (source). Since different students have 
different knowledge levels, the weight assigned to the same arc may not be the same. Thus, the weight 
across domain is jointly determined by the student model and the characteristics of knowledge (for detailed 
explanation, refer to [ 1 6] ), i.e., 
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Wij = f (djj, rriij) 

Where, Wjj is the weight of arc from i to j. 
f: R n x R m — > R+. is a non-decreasing function. 

djj is an n-dimensional vector representing the similarity of i and j. mjj is an mdimensional vector 
representing the student model, i.e., the student’ s knowledge level of i. 

The dimension of djj and mjj depends on the number of attributes considered. Moreover, the value of d^j is 
predetermined and the value of mjj is determined based on the student model. Thus, the system would carry 
an assessment module to test the knowledge of a student towards a specific supporting domain knowledge 
before tutoring begins. In this paper, we focus on the determination of m,j. 



3 The Assessment Model-A Fuzzy Approach 

Since the main purpose of the model is to test student’ s overall abilities, it is not necessary for us to gain a 
very accurate picture of it (although it helps). And somehow we also cannot gain a clear picture of student 
history. Thus, we choose a fuzzy approach in analyzing the student’ s performance, and we believe that the 
imprecise assessment of the student’ s prior knowledge level is adequate. 

3.1 The ‘ neighborhood of knowledge states’ 

The knowledge state has been defined as the subset of knowledge items from a large item pool that can be 
mastered by students [4]. Remember that knowledge items in different domains are identified by their names, 
which in turn are determined by a cross -domain vocabulary. Besides, each item is characterized by its 
relationship with other items. The neighborhood of a knowledge state was defined by Falmagne and 
Doignon [7] as all other states within a distance of at most one. It has been utilized for adaptive assessment 
by Dowling et. al. [6]. In our system, we will not measure the exact distance within knowledge items, but we 
adopt it from another perspective. We define the neighbors of a knowledge item as the possible knowledge 
items which could be mastered in association with it. Let us have a look at an example. 

Example l. 

1. ‘ <’ ,’ <=’ represent ‘ less than’ and ‘ less than or equal to’ respectively, and they are relational operators. 

2. ‘ >’ ,’ >=’ represent ‘ greater than’ and ‘ greater than or equal to’ respectively. 

3. *=’ ,’ ! =’ represent ‘ equal to’ and ‘ not equal to’ respectively, and they are equality operators. 

4. ‘ <’ , ’ <=’ can be used for both numeric and strings. 

5. ‘ >* >=’ can be used for both numeric and strings. 

6. ‘ =’ ,’ ! =’ can be used for both numeric and strings. 

7. Numeric is data type. 

8. Strings are data type. ,■ 

9. The relational and equality operators can be used for all data types, numbers, expressions or their 
combinations. 

Let M S (X) denotes the student is sure to have mastered X. And M|(Y) denotes the student is likely to have 
mastered Y. Where X,Y are sets of knowledge items. Then, 

Ms(X)Q Mj(Y) can be interpreted as “if the student is sure to have mastered X, then he/she is likely to have 
mastered Y ” 

Then we will have: 

1. M S (1)Q M|{2,4,7,8} 

2. Ms{3}0 M|{6,7,8} 

3. Ms{4,5,6}0 M s {7,8} 

4. Ms{9}0 M s { 1,2, 3, 4, 5, 6, 7, 8} 

For example, if the student knows well how to make comparisons for numeric and strings, then we assume 
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that he/she is sure to have mastered: what is numeric, what is a string and the usage of the operators. 
Although we cannot determine that whether he masters other data types or not (that is, he is likely to have 
mastered other data types such as float etc), we can assess student' s knowledge state without having to 
extensively test his abilities of each knowledge item he/she may have learned. Therefore, test items in our 
model may test knowledge items in a wider ranger than similar work by Collins et. al. [2]. 

3.2 Fuzzy Logic 

To express precisely the notion “sure”, “likely” or “unlikely”, we adopt fuzzy set methods and therefore 
using fuzzy rule for the inferences. For example, we define 

Answer = {True, False}. And Al, A2 c Answer, thus 

Ai = |i A i(T)/True + fX A i(F)/False 

Confidence = {unlikely, likely, sure}. And B1 , B2 c Confidence, thus 
Bi = fx B i(u)/unlikely + |iBi(l)/likely + |i. B j(s)/sure 
Assume we have two rules: R1:A1— » Bl and R2:A2— »B2 



Then, by Mamdani* s direct methods: 
B* = A’ oR 
Where, R = RluR2 



Ri = 



M*i(T,u) Mw(T,1) MTj) 
J4m(F,u)|ImCFJ)Mw(F,s) 



and Mw(x»y) = |X A i(x> a Mfii(y) 



Note here that all operators used, such as: +, /, c, a, u, and o, are defined in fuzzy domain 2 



To illustrate it, let us assume that Al is “doing well in bit shift operator”, A2 is “doing bad in bit shift 
operator”, Bl is “understand bit manipulation if doing well in bit shift operator”, and B2 is “understand bit 
manipulation if doing bad in bit shift operator”. Then, we can assign values such as: 

Al = 1.0/T A2 = 1 .0/F 

Bl= 0.5/1 + 0.5/s B2= 1.0/u + 0.1/1 

And satisfied: Rl: Al — » Bl and R2: A2 — » B2. Thus, 







Mbi(u) 


MfiiO) 


Rbi(s) 






0 


0,5 


0.5 


Mai (T) 


1.0 


^ 0 


0,5 


0.5 


Mai (F) 


0 


_ 0 


0 


0 






Mb2(u) 


MB 2 O) 


HB2(S) 






1.0 


0.1 


0 


MA2 (T) 


0 


^ 0 


0 


0 " 


Ra2 (F) 


1.0 


1.0 


0.1 


0 



2 Many books [18,19,20] in fuzzy set theory provide good explanations on these operators. We are not going 
to explain it further in this paper due to limited space. 
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With two rules, the fuzzy relation Ri is made from the implication Ai — » Bi (in this case, i=l,2). The 
compiled fuzzy relation R is given as Mamdani’ s method: 

R = R1 u R2, computed as: 



R = 



0 



0.5 0.5 



L 1.0 0.1 0 J 

Now, assume after a series of testing, a student performance show A*= 0.9/T + 0.2/F in doing bit shift 
operator. Then, we can calculate his performance in bit manipulation as: 



B* = A’oR 

T F 
= [0.9 0.2] 



o 




1 1.0 



1 s 

0.5 0.5 ^ 

0.1 0 



= [(0.9 a 0) v (0.2 a 1.0), 

(0.9 a 0.5) v (0.2 a 0.1), 
(0.9 a 0.5) v (0.2 a 0)] 



= [0.2 0.5 0.5] 



B’ = A’ oR = 0.2/u + 0.5/1 + 0.5/s 



Which shows 0.5 likely to understand, 0.5 surely to understand and only 0.2 unlikely to understand bit 
manipulation. 



4 Questionnaire and Testing 

The questionnaire part consists of a series of knowledge items to be checked by students. The knowledge 
items are grouped into several groups based on the their similarities and difficulties. Then, students are asked 
to fill the form about their mastery level in each group. Five grades are provided for each answer, i.e., very 
familiar, familiar, moderately familiar, not familiar, and never heard. After students provided their answers, 
the system retrieves a series of testing questions based on the difficulty (upper limit) of students’ answers, 
especially for the items marked ‘ moderately familiar’ . But it does not mean that the presumably mastered 
items are not tested at all. Even the items marked ‘very familiar’ will be tested, but with a very low 
probability. Testing could be in the forms of short program lists or short questions, which are made as short, 
clear, and simple as possible. The reason is to avoid noise or errors which do not come from student 
knowledge iteself. In order to avoid ambiguity in judging knowledge level when the question is not 
answered well, every question only consists few higher level concepts to be handled. 

Moreover, an average of membership value is used if the same item occurs in several questions. (We can use 
Bayesian update but with higher cost, i.e., to set all the conditional probability among every question). 

For example, if from question 1, 2 and 3, a student performance on 4 bit manipulation’ shows 

0.8AT + 0.2/F, 0.9AT + 0.3/F, and 1.0/T + 0. 1/F respectively, 

then the overall performance is, simply, the average, i.e., 0.9/T + 0.2/F. 

If the question needed does not exist in the database, then a similar question is retrieved. The measure of 
similarity is based on the maximum number of high level concept appeared. 

Prerequisite relationship 

In addition to the neighborhood relationships, prerequisite relationships are also applied. The prerequisite 
relationship provides not only test item ordering criteria in a “strong” sense, but also in a “weak” sense. In 

ordinary prerequisite criteria P(A, B) denotes “A is prerequisite of B”. In our extended criteria, we introduce 
A’ as: 



If A’ is closely related to A and M s (A’)0M s (A) 

then we have P* (A’ , B), that is, A’ is weakly prerequisite of B. 

So, if students have mastered item A’ , we have: they are sure to have mastered B without testing whether 
they have mastered item A or not. By doing this, we can largely tighten the testing items and thus save more 
time. 



5 Discussion 

To know student’ s learning history and his knowledge level, we cannot ask them too detailed questions in 
order to gain a more full picture of their knowledge state (although it helps) since it will make student 
modeling itself a kind of a complex system. But we need them to aid in the assessment, so how much trust 
should we have in the student’s own assessment? This is the question we need answer before we proceed. In 
our system, we will not generate the tutoring graph solely based on their answers. Our solution is to test by 
giving them several pre-stored test items: if they can write out the outcome correctly, we assume that he has 
mastered the knowledge pieces and rules needed for this program. 

Thus, the assessment will proceed. Test items need not to be like traditional testing questions in classrooms. 
They can be mini-programs or short questions provided that they can be used as a guide to assess students’ 
mastery level of declarative knowledge. 

Furthermore, we also should consider the nature of the language. For example, If the student has studied 
both Prolog and Java before , considering the respective relationship of them with Perl, we will still use Java 
as supporting knowledge because it is closer to Perl. This factor is called Knowledge Relation (K-R), and it 
will be assigned to d^j. 

At the end of the self-assessment section, a directed tutoring graph is generated. And student will be tutored 
based on it. 

Currently, we are constructing the fuzzy rules which are applied for the assessment module, followed by the 
implementation and evaluation of it. 
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A Learning Environment for Problem 
Posing in Simple Arithmetical Word 

Problems 
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Several researchers indicate that to pose arithmetical word problems is an 
important way to learn arithmetic. However, the problem posing practice 
actually is not popular. In this paper, we describe an Intelligent Learning 
Environment which realizes the problem posing practice. In the problem posing 
practice, the learners pose problems by using the tools provided by the ILE. The 
ILE has a facility to diagnose the problems posed by the learners. By using the 
result of the diagnosis, the ILE indicates whether the problems are correct or not, 
helps the learner to correct the wrong problems, and provides the next step of 
problem posing. We used the ILE in three different situations for evaluation. The 
subjects were elementary school teachers and elementary school students. We 
also report the results of the evaluation. In the ILE, the interface was 
implemented in Java, and the diagnosis module was implemented in Prolog. So 
it can be used on World Wide Web. The current environment deals with simple 
arithmetical word problems. 

Keywords: intelligent learning environment, problem posing, intelligent 
tutoring system, interactive education, World Wide Web 



1 Introduction 

The main purpose of the practice to solve arithmetical word problems is to make learners recognize the 
relations between concepts and numerical relations, and master to use the relations. Although the problem 
solving practice is the most popular way, it is not the only way. Several researchers indicate that to pose 
arithmetical word problems is also effective. However, the problem posing practice actually is not popular. 

The main reason is that the problem posing practice is strongly required teachers to deal with each learner 
individually in comparison with the practice of problem solving. We aim to realize computer-based learning 
environments for the problem posing practice [1]. For the problem solving practice, many ILEs are 
developed so far [2-6]. However, there are few ILEs for the problem posing practice until now. 

This paper describes an Intelligent Learning Environment for the problem posing practice for simple 
arithmetical word problems that can be solved by the addition of one time or the subtraction of one time. 
The main characteristic of the ILE is the function to diagnose the posed problems. By using the results, the 
ILE indicates errors in the posed problems and suggests that the next step of problem posing. 

Interface of the ILE was implemented in Java, and the diagnosis module was implemented in Prolog. 
Therefore, if only users have a computer connected to Internet with a popular internet browser, they can use 
the ILE through WWW: E-mail: nakano@minnie.ai.kvutech.ac.jp 

http://www.minnie.ai.kvutech.ac.ip/-nakano/problem-posing.shtml (currently Japanese only). 

In this paper, the first, the necessity of problem posing and an Intelligent Learning Environment for it are 
described. Then, interface and diagnosis module of the ILE are explained. The results of preliminary 
evaluation of the ILE are also reported. 
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2 Background 

2.1 The necessity of an ILE for problem posing 



Several researches about problem posing of arithmetical word problems suggested that problem posing was 
important to learn arithmetic, for example, analysis and investigation about the task of problem posing [7,8], 
investigation about effect of the problem posing practice [9], investigation in the problem posing practice at 
arithmetic class [10,1 1]. Besides, the Curriculum and Evaluation Standards for School Mathematics (in USA, 
1989), and Professional Standards for Teaching Mathematics (in USA, 1991) also indicated that it was 
important for learners to experience to pose problems. 

However, the practice actually is not popular in arithmetic class in comparison with problem solving practice. 
In the practice of problem solving, every problem has an answer and one or a few solution methods. 
Therefore, the teachers can easily judge the results of problem solving by learners. Then when the answer is 
wrong, to tell the correct answer or the solution method is not meaningless. 

In contrast with problem solving practice, to prepare every correct problem in the problem posing practice is 
very difficult. Besides, the correct problem that a learner is trying to pose, after depends on the wrong 
problem posed by the learner. Therefore, the teachers have to examine each problem whether the problem is 
correct or not, and where of the problem is wrong. 

Based on this consideration, we believe that to realize an ILE for problem posing with problem diagnosis 
function is the promising way to make learning by problem posing popular. 

2.2 The problem posing dealt in the ILE 

Silver has noted that the term "problem posing" is generally applied to three quite distinct forms of 
mathematical cognitive activity [12]. They classified three types of problem posing: (1) presolution posing, 
in which one generates original problems from a presented stimulus situation, (2) within-solution posing, in 
which one reformulates a problem as it is being solved, and (3) postsolution posing, in which one modifies 
the goals or conditions of an already solved problem to generate new problems. The problem posing deal in 
our ILE is (2) within-solution posing. In the ILE, because, in the ILE, first, a learner decides a calculation 
formula to solve the problem, and next, he/she is trying to pose problem solved by the calculation. 

Currently, the LIE can deal with only Change-Problem[13]. In Change-Problem, the quantity in the initial 
situation is changed to the quantity in the final situation by the change action. The Change-Problem usually 
consists of three sentences: the first sentence describes the initial situation, the second sentence describes the 
change action, and the third sentence describes the final situation. Therefore, we prepare a “problem 
template” that composed of three single sentence templates. By filling in the blanks of three single sentence 
templates, the problem is completed. 

In the ILE, the template of Chang-Problem is composed of the tree single sentence templates that describe: 
initial situation, change action, and final situation, respectively. The initial situation has the four information: 
"owner", "object", "number", and "unit". This means that "owner" has "object" and the number of "object" is 
"number", then, the unit of the number is "unit". The change action has the five information: "actor", 
"object", "number", "unit", "action". Several actions, for example, “take” has two more information: “from” 
and “to”. The final situation has the four information: "owner", "object", "number", and "unit". 

3 ILE for problem posing 

3.1 Configuration of the ILE 

The current version of the ILE consists of clients and server shown in Figure 1 . A client is an interface of the 
ILE. The interface provides learners the tools to pose problems and gives them guidance to promote problem 
posing. Inter face is explained in more details in this section 3.2. 

The server has two modules: the one is Problem Diagnosis Module and the other is Advice Generator. First, 
the ILE receives the posed problem, and diagnoses it in Problem Diagnosis Module. Next, in Advice 
Generator, the ILE generates advice for each learner by using the result of diagnosis. These are explained in 
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more details in this section 3.3. 



Because the ILE deals with several learners by one server, the ILE manages ID, PW, and Learner Model in 
Private Information Manager. 




Figure 1 : The frame of the ILE 



3.2 Interface 

Figure 2 shows the interface of the ILE. Current interface deals with only Japanese. In Figure 2, Japanese 
was translated into English for this paper. The parts of the interface are expressed as follows. 




• Calculation Formula Panel 

In this panel, a learner gives calculation formula. The learner poses problems which can be solved by this 
calculation formula. 

• Concept Panel 

This panel provides concepts to fill in blanks of sentences (three single sentences templates). The concepts 
that are provided in the Concept Panel are classified in the five categories: “human”, “object”, “unit”, 
“action”, “number”. 

• Ten-key 
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Figure 3: An example of posing sentence 
by using Single Sentence Template 

learner answered the questions. The result shows “Tom has 5 pieces of Apple Pies”. 

By answering the all questions, learners pose problems For example, Figure 2 shows the correct problem in 
Problem Posing Panel: the initial situation is “Tom has 5 pieces of Apple Pies”, the change action is “Tom 
eats the 3 pieces of Apple Pies”, and the final situation is “Flow many pieces of Apple Pies does Tom 
have?”. 

• Comment Panel 

This panel shows advice and suggestion massages that are generated based on the diagnosis of the posed 
problems. 

3.3 Problem posing in the ILE 

A learner poses a problem by the following process. 

(1) . Giving a calculation formula 

First, the learner gives a calculation formula. The calculation formula consists in three elements. That is, 
two operands and an operator. Because the calculation formula is the way to get the answer of the problem, 
we call it solution. 

The solution can be applied to several numerical relations. For examples, if the learner assigned “5-3” 
to the solution, the solution can be applied to the following four numerical relations: (a) “5-3=X”, (b) 
“5-X=3”, (c) “3+X=5”, (d) “X+3=5” (the current version of the ILE only handles natural numbers). Here, 
numerical relation (a) means the answer is the number in the final situation, numerical relation (b) and (c) 
mean the answer is the number in the change action, and numerical relation (d) means the answer is the 
number in the Initial situation. 

(2) . Selecting concepts from Concept Panel and combining them with the template of Change-Problem 

The template has several blanks, and the ILE asks the learner to pose a problem by filling the blanks 
with the concepts. Then, if the learner selected a concept from the set of wrong concepts, the ILE can give 
the learner feedback, which suggested that the concept is wrong. 

(3) . Request to diagnose a problem 

When the learner clicks the “diagnosis button”, the problem is sent to the server and is diagnosed. 

(4) . Revising the wrong problem by using the suggestion given in the Comment Panel 

When the posed problem is wrong, the learner receives feedback that indicates an error at Comment 
Panel. 

The ILE generates the message by using the result of the diagnosis. 

(5) . Posing the new problem by using the suggestion 

When the learner posed the correct problem, the learner receives feedback which is suggests to pose the 
new type of problems. 

3.4 Problem Diagnosis Module and Advice Generator 




Numerical values are put into blanks of sentences with 
Ten-key. 

• Problem Posing Panel 

In the current version, this panel provides the template 
of Change-Problem. The ILE asks a learner to fill in 
blanks of sentences. In the order of the blanks, the ILE 
gives questions. By answering the questions, the blanks 
are filled in. Here, the learner has to select concepts from 
Concept Panel. By using Figure 3, posing a sentence of 
initial situation in Chang-Problem is explained. The left 
side of the figure shows questions. 

For example, the initial situation in Chang-Problem is 
composed of four elements: “owner”, “object”, “number” 
and “unit”. So, the ILE asks the learner “Who has?”, 
“What the person has?”, “How many?”, “What is unit?”. 
The learner also should decide what number is the answer 
by selecting the question mark in Ten-key. 

The right side of the figure shows an example which the 




Problem Diagnosis Module and Advice Generator are functions of the server in the ILE. Problem Diagnosis 
Module diagnoses problems sent by the client, and Advice Generator generates messages that are provided 
for each learner. 

The ILE, first, diagnoses a single sentence and then diagnoses the problem composed of three sentences, and 
compares the solution given by a learner with the problem posed by the learner. In the first step, the module 
has knowledge about acceptable sentences (initial situation, change action, final situation). We call each 
sentence “basic relation”, and the knowledge “single sentence schema”. The single sentence schema checks 
each basic relation to find the errors in a sentence. 

In the second step, the relation among the sentences is diagnosed. The module has the knowledge about 
acceptable relations among basic relations. We call the knowledge “problem schema”. The problem schema 
checks the numerical relation between the sentences to find the wrong sentence in the problem. 

In the third step, the relation between the solution and the problem is diagnosed. 

In the following section, the diagnosis process is explained. Then, the feedback made by the diagnosis result 
is presented. 

3.4.1 Diagnosis of the posed problems 

Diagnosis of the posed problems is carried out in three steps: the first step is the diagnosis of a single 
sentence. The second step is the diagnosis of the problem composed of three sentences. The third step is the 
diagnosis of the relation between the problem and the solution. 

(1) . Diagnosis of a single sentence 

In this diagnosis, two types of errors are detected: (1 -a) errors in the relation between object and action, 
and (1-b) errors in the relation between object and number. Here, Mismatch of blanks (that is, object blank 
or action blank and so on) and concepts is already checked in the interface. 

An example of (La) is a sentence that "Tom eats his 2 sheets of postcards.” "Tom has 5 cups of apple 
pies" is an example of (1-b). These errors are detected by checking with sentence schema in that the 
acceptable relations between object and action or object and number are described. 

(2) . Diagnosis of problem 

In this diagnosis, three types of errors are detected: (2-a) errors in the final situation, (2-b) errors in the 
change action and (2-c) no relation errors. (2-a) means that the initial situation can be changed by the change 
action, but cannot be changed to the final situation. (2-b) means that the initial situation can be changed to 
the final situation, but cannot be changed by the change action. (2-c) means that the initial situation cannot 
be changed by the change action and to the final situation. These errors are detected by comparing by 
problem schema in that the acceptable relations among the situations and the change action are described. 

An example of (2-a) is the problem composed of the following three sentences: "Tom has 5 pieces of 
apple pies", "Nancy eats Tom's 3 pieces of apple pies" and "how many pieces of lemon pies does Tom 
have?" An example of (2-b) is the problem composed of the following three sentences: "Tom has 5 pieces of 
apple pies", "Nancy eats her 3 pieces of apple pies, and "how many pieces of apple pies does Tom have?" 

(3) . Diagnosis of the relation between the problem and the solution 

The diagnosis module can generate an equation from the problem. In this diagnosis, first, the module 
solves the equation. Then the calculation to derive the answer is compared with the calculation posed by the 
learner as the solution. When the two calculations do not correspond, an error in the relation between the 
problem and the solution is detected. 

3.4.2 Feedback for the client 
(1). Indication of an error 

If the diagnosis module finds an error, the ILE indicates it. Even if the problem includes several errors, the 




ILE indicates the error detected first. 

(2). Suggestion of the next step of problem posing 

The ILE suggests the next step of problem posing when the posed problem is the correct one. In the 
diagnosis, the module diagnoses not only whether the problem is correct or not, but also what concepts, 
actions or equations are used in the problem. Based on the results, the ILE can suggest more difficult 
problem posing by specifying concepts or an equation type to be allowed to use in problem posing. 



4 Preliminary evaluations 

A prototype of the ILE has been already developed. We used it in three different situation for evaluation, as 
follows: (1) Use by teachers of the elementary school, (2) Use by students of elementary school in arithmetic 
classes, (3) Use by students of elementary school outside the class. 

In (1), we asked the teachers to evaluate the ILE from the viewpoint of teaching. Then, two of them 
permitted us to use the ILE in their arithmetic class. So, we had two opportunities to evaluate the ILE in the 
second situation. In (2), we asked the students of elementary school to pose arithmetical word problems with 
the ILE in two arithmetic classes. In the trial, although we collected the answers for our questionnaires, we 
failed to record logs of problem posing. Therefore, we could not get the data about the number of posed 
problems, and the students behave for feedback from the ILE. In (3), we gathered several students again, and 
asked them to use the ILE out of class. Here, the students used the ILE for the first time. 

In this section, we report these results. 

4.1 Use by the teachers of the elementary school 

To evaluate a learning environment, the evaluation by teachers is important. We asked five teachers of 
elementary school to use the ILE. After they posed several problems by using this ILE, we asked them 
several questions. The questions are as follows: (1) How do you evaluate the effect of problem posing to 
learn arithmetic? (2) How do you evaluate the way of problem posing used in the ILE? (3) How do you 
evaluate the interface? (4) How do you evaluate the indications for the errors in posed problems? (5) How 
do you evaluate the advises to suggest the next step of problem posing? Table 1 shows the results. 

Table 1: Evaluation of 

Table 1-(1) means that all teachers think to learn arithmetic by using problem 
posing is effective. Table l-(2) suggests that the ILE realizes an useful 
environment for learning by problem posing. Two teachers out of three teachers 
who answered “Good” to the question (2), gave us opportunities to use the ILE 
in classes. A few teachers also indicated that the limitation of concepts that were 
allowed to use in problem posing should be revised. This is one of our future 
works. In Table l-(3), three teachers answered “So-so”. The result means that 
the interface is not always easy to use. In Table l-(4), four teachers answered 
“Good”. The result suggests that the indications for the errors in the posed 
problem are acceptable. However, several teachers also indicated that the 
sentences of the indications may be difficult for elementary students. In Table l-(5), the all teachers 
answered “Good”. This result means that the teachers think the suggestions to make learners progress the 
next step of problem posing adequately support learning by problem posing. 

4.2 Use by the students of elementary school in arithmetic classes 

We used the ILE in two classes: the one was composed of 25 
students in third grade and the other was composed of 30 students in 
fifth grade. In each class, 15 minutes were used to explain the use of 
the ILE, and 20 minutes were used for the problem posing practice 
with the ILE. In this problem posing practice, students were two 
people one set, and they operated one personal computer with two. 

Then two assistants assisted them to operate the ILE in the 
experiments. 



Table 2: Evaluation of the 
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We asked two questions after the problem posing practice: (1) Are you interested in problem posing by using 
this ILE? (2) Do you want to pose more problems by using this ILE? The result is shown in Table 2. 

The results suggested that most students were interested in problem posing with the ILE. But we were not 
able to get enough data to confirm that the students pose problem well. 



4.3 Use by the students of elementary school outside the class 



Subjects were one student of fourth-grade, and threes students of sixth-grade in elementary school. In the 
experiment, we used 1 5 minutes in the demonstration of this ILE, and 25 minutes in the problem posing 
practice. The results were as follows. In Table 3, Diagnosis indicates the number of time of request to 
diagnose. 



Table 3: Logs of the problem posing 
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a: A±B=X, p: A±X=C, y: X±B=C (A,B,C are numerical values. X is a variable) 
C: Correct, W: Wrong 



In Table 3, equations named by Greek ( a , 0 , y ) specify the type of problem posed by subject. “A” is the 
number in the initial situation, “B” is the number of the change action, and “C” is the number in the final 
situation. “X” is the number that is derived by the solution. In the a type, the answer is in the final 
situation. So this type of problem is the easiest one. In the fl type, the answer is in the change action. In the 
y type, the answer is in the initial situation. In this order, problems become difficult. The ILE can judge not 
only “C (correct)” or “W (wrong)”, but also the type of problem whenever the student requests the 
diagnosis. 



In Table 3, three subjects (i, ii, iv) tried to pose the problems of the all types, and subject-iii tried to pose the 
two types of the problems. The subject-i posed the wrong problem of the y type on the 3 rd request to 
diagnose in the practice. And the subject was repeating to revise it in seven times. As a result, the subject 
posed the correct problem of the y type in the 10 th trial. And the subject-ii posed the wrong problem of the 
type on the 3 rd request to diagnose in the practice, then the subject posed the correct problem of the 
type in the 4 th trial. And the subject-iv posed the wrong problem of the y type on the 3 rd request to 
diagnose, then the subject posed the correct problem of the y type in the 9 th trial, too. But, the subject-ii 
gave up to correct the wrong problem of the y type, although s/he was repeating to revise the wrong 
problem in three times. The results suggest that the feedback is effective to forward the learner to revise the 
wrong problem. 



In the current ILE, if a learner corrected the problem, the ILE suggests the next step of problem posing. The 
first step is problem of the a type, the second step is problem of the 0 type, and the third step is problem 
of the y type. In Table 3, all subjects follow the suggestion. In the results, when a learner posed a correct 
problem, the learner can not poses only the same type of problem again, but also other types of problem by 
using the feedback. This suggests that the feedback is also effective to advance the next step of problem 
posing. 

Conclusions 



5 Conclusion 

In this paper, we described ILE for problem posing in simple arithmetical word problems. The ILE provides 
the template to pose Change-Problem in current version. And the ILE can diagnose the problem that learners 
fill blanks of the template with several concepts, values, and question mark. Besides, the ILE can support 



each learners by using the results of diagnosis. We used the ILE in three different situations for evaluation. 
In the results, we consider that this research provides basis functions to realize the problem posing practice 
by ILE about simple arithmetical word problems. 

In future work, we will refine functions in the ILE. For example, in the ILE, we will deal with not only 
Change-Problem, but also the other types of problems. And we will develop a function in which teachers can 
customize concepts provided for their students in their problem posing practice, because teachers hope to 
use concepts which are popular in their classroom. Then, we will evaluate the ILE again in order to 
investigate about the effect to learn arithmetic. 
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The method of creating counterexample by using educational simulation is 
proposed. Error-Based Simulation (EBS) is used for this purpose, which 
simulates a learner's erroneous equation in mechanics problem. A learner's error 
is visualized as unnatural motion of a physical object. In order for EBS to be 
effective as counterexample, the followings are essential: (1) A learner can 
recognize the difference of unnatural motion in EBS from natural one in correct 
simulation, and (2) EBS must provide a learner sufficient information to 
understand the cause of error and to reach correct understanding. The former has 
been studied in the authers' previous works. In this paper, the latter is discussed. 

To identify a learner's error, misconceptions are classified based on problem- 
solving model, and are linked to their appearance on a learner's answer (error- 
identification rules). Then, to indicate the cause of error by EBS, unnatural 
motions in EBS are classified and linked to the misconceptions which they 
suggest (error-visualization rules). These functions are realized as rule-base 
systems. The architecture of EBS management system, which judges a learner's 
error and generates the suitable EBS using these functions, is proposed. 

Keywords: counterexample, simulation, mechanics, error, student model, 
motion perception 



1 Introduction 

It is well known that cognitive conflict promotes learning process. It often occurs when a learner encounters 
the fact which is contradictory to her/his idea. Cognitive conflict motivates a learner to reconsider her/his 
idea, and often causes conceptual change [Gagne 85, Fujii 97]. 

Counterexample is useful for creating cognitive conflict. It provides a case in which a learner's idea doesn't 
account for the fact, or her/his procedure doesn't produce the correct solution. 

However, one must be careful in using counterexample, because a learner often ignores or refuses it. Even 
when she/he accepts the counterexample, she/he needs some kinds of help to reach correct understanding. 
Without any assistance, a learner often comes to an impasse, or makes ad hoc rules which explain the 
exception only. Therefore, in using counterexample, the followings are essential [Fukuoka & Suzuki 94, 
Nakajima 97]: 

(1) Counterexample must be recognized to be meaningful and acceptable. When the difference is clear 
and reliable between counterexample and a learner's expectation, she/he easily accepts it and 
reconsiders her/his idea. 

(2) Appropriate assistance must be provided to lead a learner to correct understanding. Counterexample 
must include sufficient information for this. It will be helpful to explicitly describe the 
distinguishing attributes of counterexample. 
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Error-based Simulation (EBS) is an educational simulation which provides a learner counterexample. It 
simulates an erroneous equation made by a learner in solving mechanics problem. In EBS, a learner's error 
often appears as unnatural motion of a physical object, which differs from her/his prediction (She/he can 
usually predict the correct motion). 

The authors have developed the method of generating effective EBS mainly from the above viewpoint (1) 
[Hirashima et al. 98, Horiguchi et al. 99]. The condition on which a learner can recognize the difference 
between EBS and correct simulation was formulated (Criteria for Error-Visualization: CEV), and the 
mechanism to estimate the quality of difference was proposed, which considers both clarity and reliability of 
the difference. 

However, though such an EBS motivated a learner by indicating the existence of errors, it was not sufficient 
to lead her/him to correct understanding. It didn't provide sufficient information for this. 

Therefore, this paper proposes the method of managing EBS from the above viewpoint (2). EBS must justly 
indicate the cause of a learner's error, and suggest how to correct it. The followings are the requirements and 
approaches for this purpose. 

(a) The function which identifies the cause of error behind a learner's erroneous equation or her/his 
handwriting diagram. 

Approach: First, construct a problem-solving model of mechanics. Secondly, based on the model, 
classify the misconceptions which occur in problem-solving as causes of errors. Thirdly, classify 
the appearances of the misconceptions on a learner's equation or handwriting diagram. Lastly, 
appearances and causes of errors are linked together correspondingly. These are called Error- 
Identification Rules. 

(b) The function which generates the EBS indicating the identified cause of error by unnatural motion 
of a physical object. 

Approach: First, classify the unnatural motions in EBS. Then, link them to the corresponding 
causes of errors, considering what kind of unnaturalness suggests what kind of misconception. 
These are called Criteria for Cause-of-Error-Visualization. With these criteria, EBSs are estimated 
their effectiveness. When there is no EBS which is judged effective, other teaching methods will be 
considered. 



2 Previous works in Error-Based Simulation 

Before proceeding to the main topic of this paper, we outline the stream of study in Error-based Simulation, 
which may be helpful to clarify the present problem and the position of this paper. 

Stage 0 (Hirashima et al. 98 for summary] 

The fundamental idea of EBS is very simple. In mechanics problem, many learners feel difficulty in thinking 
by equations, so EBS maps their equations from mathematical world to physical world. It embodies a 
learner's error as unnatural motion of a physical object, which makes it much easier to recognize the error. 
Here, we assume that unnatural motion in EBS is differ from a learner's prediction, that is: 

Precondition-1 : A learner can predict the correct motion (in spite of her/his erroneous equation). 
This precondition is set through all stages of the research of EBS. 

Stage 1 [Hirashima et al. 98] 

Apparently, the key of this method is how a learner sees the difference between the unnatural motion in EBS 
and the predicted natural motion. At least, the difference must be noticed by a learner. When the difference 
of two motions is small, she/he may not notice it, or cannot judge which motion is correct (unfortunately, the 
ability of human vision is not so sensible). Therefore, we set the following assumption: 

Assumption-1 : EBS must satisfy CEV-1 and/or CEV-2 below to indicate the existence of error. 
Condition for Error-Visualization 1 (CEV-1): There is a qualitative difference between the 
motion in EBS and the one in correct simulation, that is, the qualitative values of a physical object's 
velocity are different between them. 

Condition for Error- Visualization 2 (CEV-2): There is a qualitative difference between the 
change of motion in EBS and the correct simulation, that is, the qualitative values of the derivative 
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of a physical object's velocity are different between them. 

Stage 2 [Horiguchi et al. 99] 

When regarding EBS as counterexample, the viewpoints (1) and (2) in chapter 1 are important. We 
previously worked out how to estimate the effectiveness of EBS from the viewpoint (1). It is subdivided into 
two viewpoints: (1-1) how clear the error appears in EBS, and (1-2) how reliable the EBS is as 
counterexample. 

From the viewpoint (1-1), the more CEVs the EBS satisfies, the more effective it is. In general, changing 
parameters of the mechanical system makes EBS satisfy more CEVs. lor example, in Figure 2, the EBS 
based on erroneous equation m2a = T + pm2g (Figure 2d) satisfies CEV-1. (The qualitative value of relative 
velocity between two blocks is [+], while it is [0] in normal case.) But, when the mass of m2 increases, the 
EBS becomes to satisfy CEV-2 besides CEV-1. (The velocity of m2 increases, while it decsreses in normal 
case.) We categorized the methods of parameter-change and their influence on the clarity of errors. 

However, from the viewpoint (1-2), such parameter-change harms the reliability of EBS, because a learner 
feels it factitious to change parameters too largely. The smaller parameter-change the EBS has (no change is 
the best), the more reliable it is. This discussion is summarized as follows. 

Assumption-2: From the viewpoint of clarity, EBS should satisfy more CEVs. 

Assumption-3: From the viewpoint of reliability, EBS should have less parameter-changes. 

Stage 3 [just this paper] 

In estimating the effectiveness of EBS, there is another, and important viewpoint: whether the EBS provides 
appropriate information for correcting the error, that is, the viewpoint (2) in chapter 1 . Stage 0-2 have been 
mainly concerned with how to make a learner notice the error, while at this stage, our concern is how to 
make him correct the error. 

For example, consider the erroneous equation m2a = T + pm2g (Figure 2d). From the viewpoint of 
reliability (1-2), the EBS shown in Figure 2c is generated. But it shows the string between two blocks 
shrinking, which may suggest something is wrong about tension of the string. It is misleading because the 
real cause of error is the friction of m2. In this case, the EBS in Figure 2e should be generated to indicate the 
cause of error. (It is generated when taking the viewpoint of reliability (1-2), but by accident.) 

Of course, the viewpoints (1-1) and (1-2) are useful to impress on a learner the existence of error. However, 
in considering the error-correction, to generate EBS from the viewpoint (2) becomes necessary. It is the very 
topic of this paper. 



3 Mechanism for Identifying the Cause of Errors 

Now, we'll explain how to realize the functions described in chapter 1 . The mechanism for identifying cause 
of errors is realized as follows: 

1. to generate the correct solution by problem-solving model. 

2. to specify the erroneous part of a learner's solution by comparing with the correct solution. 

3. to identify the cause of error by applying the Error- Identification Rules, which link the appearance 
of erroneous part to its cause. 

Here, a learner's solution means the equation and handwriting diagram made by her/him, from both of which 
the information about her/his problem-solving process is derived. 

3.1 Problem-Solving Model 

We deal with the mechanics problems of high school level, which ask a learner to set up equation of motion 
by using Newton's second law. The problem-solving process is divided into three steps [Robertson 90, 
Plotzner 94]: 

step-1 to predict the motion of physical objects in the mechanical system qualitatively. 
step-2 to enumerate the forces acting on each object. 

step-3 to compose the enumerated forces and substitute them for the left side of formula F = ma. 
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erroneous equation: ma= F 




Figux 1. Example Problem- 1 



In step-1, a learner predicts the motion of objects in the system, and gives each object acceleration vector. 
Approproate axes are also set up. In step -2, she/he enumerates the forces which aren't given in problem 
description. Both qualitative knowledge (what kind of force acts in which direction?) and quantitative one 
(algebraic description of the magnitude of force) are used. In step-3, she/he decomposes/composes the 
enumerated forces along the axes, and substitute them for the formula F = ma. 



In this paper, we don't model the error-occurring process in step-1, because it is presupposed that a learner 
correctly predicts the qualitative motion of objects in using EBS (Precondition- 1 in chpter 2). We also omit 
the occurrence of error in step-3, which mostly concerns the knowledge of vector calculation. 



Therefore, modeling step-2 is our central issue. Takeuchi and Otsuki (1997) considered that a learner 
constructs a model of causal structure of mechanical system, with which she/he infers the occurrence and 
propagation of forces. They formulated this process as a set of production rules. We modify them 
considering their qualitative/quantitative characteristics. A part of our model is shown in Table 1. The rules 
are called Force-Enumerating Rules (FERs). 



3.2 Error-Identification Rules 



In our model, a learner's errors are considered as the ones of FERs. The errors of FERs themselves and the 
ones in their application are included. In fact, these errors appear as the missing/extra/errors of the term of 
force in equation, or of the arrow of force in handwriting diagram. They are also linked to the strategies for 
correction. 



For example, in Figure 1 , the term of friction (-pmg) is missing in the erroneous equation. The cause of this 
error and its instruction are considered as follows: 

1) A learner doesn't know the concept of friction itself, that is, doesn't know the rule R3 (Table 1). 
Instruction: Re -teach the concept/definition of friction. 

2) A learner is overlooking the preconditions of R3, that is, overlooking the fact that the block is 
touching the floor (r3-cl ), or the fact the coefficient of friction is nonzero (r3-c2). 

Instruction: Re-show the problem and indicate the corresponding part of the diagram. 

3) A learner is missing the force which causes the friction, that is, missing the normal force (r3- 

c3). 

Instruction: Proceed to the correcting strategy of normal force. 

4) A learner doesn't think the block moves along the floor, that is, missing the relative velocity of 
them (r3-c4). 

Instruction: This is the erorr of prediction of movement. So, out of the range of this paper. But, 
it may be useful to indicate the force which causes the block's motion. 
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Through such a consideration, the appearances of errors and their causes are classified as shown in Table 2. 
These are the Error-Identification Rules (EIRs), which are applied to the erroneous part of a learner's answer 
(specified by comparing with the correct solution), to identify the cause of error. 

In Table 2, each error has its strategy for correction. Note that, it is not necessary to use EBS for every case. 
Of course, when other instruction method is more appropriate, it should be used. However, the aim of this 
paper is to clarify what kind of errors EBS is effective for, and how to estimate its effectiveness. For this 
purpose, we need to study the unnaturalness of physical objects' motion in simulation. 



4 Criteria for Cause-of-Error Visualization 

The identified error must be corrected. In this chapter, we formulate the criteria forjudging whether an EBS 
is effective for the error. It means that EBS rightly indicates the cause of error and suggests the way of 
correction. 

4.1 Motion and Forces 

In EBS, it is the motion of physical objects (or their relationships) to be observed. Therefore, we classify the 
motions and connect them to the mechanical concepts they suggest. 
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How does a human perceive and recognize moving objects? Though it is well known that their figurative 
characteristics (figure, size, texture, etc.) and composition (position, direction, symmetry, etc.) have great 
influence on the arising images, it is difficult to generalize them because they much depend on the cultural 
factors. Therefore, we limit our target to the physical world of simulation, in which things are thought in the 
sense of mechanics. 

When observing an object to move, a human feels its motive ‘force* working. Of course, this kind of 'force' is 
of naive impression and doesn't always correspond to the real force. But it appeals to human's intuition so 
much more. Bliss & Ogbom (1992) classified such naive concepts of force according to the stages of child 
development. Based on their findings, we consider the relations between the motions in EBS and the forces 
they suggest. 

4.2 Motion of a single object 

A moving object arises the feeling of force working, (e.g. A falling down ball suggests gravity.) Therefore, 
the object moving unnaturally in EBS is supposed to suggest the erroneous force acting on it. (e.g. gravity, 
friction etc.) Unnatural motions of a single object are classified as follows: 

(a) Directions of both velocity and acceleration are opposite to the ones of correct motion. 

(b) Direction of only velocity is opposite to the one of correct motion. 

(c) Direction of only acceleration is opposite to the ones of correct motion. 

(d) Directions of both velocity and acceleration are same as the ones of correct motion. 

Here, it is assumued that human can distinguish at most the qualitative difference of velosity or acceleration 
of an object in motion [Hirashima et al. 98, Horiguchi et al. 99]. 

For example, in case (a), when a learner observes an object moving in the opposite direction to her/his 
prediction (which is correct), she/he will recognize that the force is missing which acts in the predicted 
direction, or that the force is extra which acts in the present direction. 

Table 3 shows the relations between unnatural motions and the errors they suggest. They are called Criteria 
for Cause-of-Error Visualization (CCEVs). 

4.3 Relative Motion of two objects 

Moving plural objects also arises the feeling of force working. We limit to two objects. When observing two 
objects moving together, the force maintaining their relative motion is felt. (e.g. A moving dolly pulling 
another one connected by string suggests tension.) Therefore, two objects relatively moving in unnatural 
manner in EBS are supposed to suggest the erroneous force interacting between them. (e.g. tention, normal 
force etc.) Unnatural relative motions of two objects are classified as follows: 

(e) Two objects are closing with each other, which are connected by string. (String shrinks.) 

(f) Two objects are going away from each other, which are connected by string. (String stretchs.) 

(g) Two objects are overlapping each other. 

(h) Two objects are parting from each other, which are attached together. 

For example, in case (g), when a learner observes such unnatural relative motion, she/he will recognize that 
the normal force is missing or too small which interacts between two objects. 

Table 4 shows the relations between unnatural relative motions and their suggesting errors. They are also 
called Criteria for Cause-of-Error Visualization (CCEVs). 

Note that, all of the motions in Table 3 and 4 have at least some kinds of qualitative difference from the 
correct motions. This is because, however precisely an EBS indicates the error, it isn't effective unless a 
learner recognizes it as 'unnatural.' The difference is judged with CHteria for Error- Visualization (CEVs) 
[Hirashima et al. 98, Horiguchi et al. 99]. 
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3. CritmAfcg Cause -of ‘Ecror Visualisation (CCEYQ ffor single object) 
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5 Examples 

In this chapter, we illustrate the process of identifying the cause of error and generating the EBS which 
indicates the error. The example problem is shown in Figure 2. 

5.1 A Simple Case 

First, the solution (correct equation and diagram: Figure 2a) is generated by problem-solver. Then, it is 
compared with a learner’s answer (Figure 2b) to specify the erroneous part. In this case, it is the erroneous 
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value (too large) of tension beside block m2. Secondly, EIRs (in Table 2) are applied to identify the cause of 
error. It is identified as the error of magnitude of tension. According to Table 2, the correcting strategy of 
this error is to indicate the fact. Then, CCEVs (in Table 3 and 4) are applied, to find that the motion (g) 
satisfies this demand. 



Based on the erroneous equation of Figure 2b, the EBS shown in Figure 2c can be generated, in which block 
m2 moves faster than its normal case, consequently the string shrinks. This unnaturalness is equal to the one 
of motion (g). Therefore, this EBS is judged to satisfy the instructional demand, and shown to the learner. 

5.2 A Complicated Case 



Consider the erroneous answer of a learner in Figure 2d. In this case, the erroneous part is the erroneous 
direction of friction acting on block m2. By EIRs, the cause of error is identified as the error of direction of 
friction, and the correcting strategy is to indicate the fact. Since the error of force in direction is divided into 
the missing of the force of correct direction and the extra of the force of incorrect direction (see note 2 of 
Table 3), the motions (a), (b), (d) satisfy this demand. 
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e. EBS with the perturbation of m2 



Based on the erroneous equation of Figure 2d, however, it is impossible to generate the EBS which contains 
the motion (a) or (b). In addition, even when the EBS containing the motion (d) is generated (it is possible), 
it causes the unnatural relative motion (e), which indicates another error. In fact, the EBS, in which block m2 
is closing to dolly ml (the same as Figure 2c), strongly suggests the error of tension. This misleads a learner. 

Therefore, in this case, the EBS must be modified to precisely indicate the identified error. Perturbing the 
mass of block m2 is a promising method. When the mass m2 increases, in EBS, the velocity of the block 
increases (Figure 2e). This is a strange change of motion. Observing this, a learner may think some physical 
amount is wrong which concerns the mass m2. She/he may notice the erroneous friction acting on block m2. 

As for the EBS of Figure 2e, the difference from the correct simulation is not so much clear and reliable as 
the EBS of Figure 2c. Instead, it provides precise information for correcting the error, while the EBS of 
Figure 2c doesn't. In general, plural EBSs can be generated from one erroneous equation. The best should be 
chosen according to the purpose. 



6 Concluding Remarks 

In this paper, we proposed a method of creating effective counterexamples by using Error-Based Simulation. 
The effectiveness of EBS is judged mainly from the viewpoint whether it provides sufficient information to 
recognize the cause of error and correct it. The mechanism for identifying the cause of error and for 
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generating the EBS which satisfies the instructional demand was also proposed. We are now implementing 

the mechanism. The experiment to evaluate our method is planned. 

Our future works are as follows: 

1. Cooperation with other instructional tools: Of course, EBS isn't sufficient for all of the error 
correction in Table 2. It must be studied to use other instructional tools (textbook, normal simulator 
etc.), and to coordinate them with EBS. 

2. Refinement of the problem-solving model: Our model for problem-solving is very simple, so the 
range of the error it covers is limited. We are going to refine the model, especially considering the 
process in which a learner qualitatively predicts the motion of mechanical system. 

3. Consideration of conflict among CCEVs: As is noted in section 5.2, the effects of plural unnatural 
motions sometimes conflicts each other. One unnatural motion may invalidate the effect of other 
unnatural motion. Therefore, it is necessary to set some kind of preferences to CCEVs. 
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Many of the web-based educational systems could not provide an individualized 
instruction or an interactive problem solving, since they are mostly built upon 
static hypertext. One possible approach to solve these problems could be 
adapting the existing proven techniques from the stand-alone Intelligent 
Tutoring System(TTS). Some recent web-based ITS researches show this efforts 
by employing the techniques selectively, and this needs to be studied further to 
support more effective web-based instruction. In this paper, we describe the 
design and the development of a Web based Adaptive programming Language 
Tutoring System(WALTS). The system is designed based on the ITS structure 
primarily, and it is adapting previous ITS techniques into the system successfully. 
Especially our focus is on the three levels of the instructional planning 
mechanism, which can generate lesson contents dynamically whenever it is 
requested. This way we do not need to crate all the lesson contents in HTML 
forms which must reside in the system in advance. In addition, the system has 
adapted CORBA structure to support the user more consistent and reliable 
performance. Together, the system behaves more adaptive and interactive, than 
the existing non-ITS based web systems. The test domain of the system is 
learning C programming language for the first year computer science student. 

Keywords: Web-based learning system, Intelligent Tutoring System, 
Instructional planning 



1 Introduction 

Many recent web-based educational systems could not provide an individualized instruction or an interactive 
problem solving, since they are mostly built upon static hypertext. One possible approach to solve these 
problems could be adapting the existing techniques from the stand-alone ITS. Brusilovsky [2] states that 
some ITS techniques can be adapted into a web-based educational system, and divides the techniques into 
three distinctive parts, such as, automatic creation of curriculum, dynamic problem solving, and intelligent 
analysis of student model. However, most of the recent web-based ITS research show the efforts by 
employing the techniques selectively[2][3][4][7], such as adapting student modeling or problem solving 
capability at some level. Therefore, this needs to be studied further to enhance the overall capabilities of the 
system at the previous stand-alone ITS level. For instance, automatic generation of curriculum or lesson plan 
is necessary to provide a flexible instruction for each individual user. 

In this paper, we describe the design and development of Web-based Adaptive programming Language 
Tutoring System( WALTS). The system is designed based on the ITS structure primarily, and it is adapting 
many techniques from the stand-alone ITS into the web-based systems. First, we designed the knowledge 
base using the object-oriented method in order to handle flexible management of object inheritance and 
tutorial strategies. Second, the student modeler can avoid the network traffic by designing the modeler stays 
in the server-side at the beginning of the session for maintaining necessary administration duties, and creates 
an individual student model in the client side. And the third important approach is having the instructional 
planning mechanism, which generates lesson contents dynamically for each individual user. This is 
important feature for moving towards the web-based system, because most web-based educational systems 




38 



creates all the lesson contents in HTML forms in advance, and they must reside in the system physically. 
And then the user navigates the system for learning, such as in ELM-ART [2] or CAL AT [4]. Intelligent 
navigation strategy might be one of the intelligent way of guiding the user to learn the material, but rather 
inefficient compare to the dynamic generation of lesson contents. WALTS only generates the necessary 
lesson contents whenever it is requested by the system, which can be another advantage. In addition, we 
have approached distributed architecture by employing CORBA(Common Object Request Broker 
Architecture) structure to support the user more consistent and reliable performance while the user using the 
system. The initial web-based educational systems are mostly developed by using the CGI(Common 
Gateway Interface) techniques, which often results in bottleneck problem when many users access the 
system at the same time. In this sense, our structure might avoid such a problem, and the system could also 
be easily updated when we need to revise some part of the system. Together, the system behaves more 
adaptive and interactive, than the existing non-ITS web-based educational systems. The test domain of the 
system is learning C programming language for the first year computer science student. 

The rest of the paper is organized as follows. In section 2 we described a distributed infrastructure of 
WALTS system. Section 3 presents each components of the system and also some intelligent aspects of the 
system. We conclude the paper in section 4. 



2 Distributed infrastructure 

The previous web-based educational systems have been built as either a server-based architecture or a client- 
based architecture [6]. Each of them has some advantages and disadvantages. The server-side architecture 
mostly rely on CGI techniques, which has shown some problems of handling complex client/server 
communication because of its connectionless feature. Also client-side architecture needs to have all the plug- 
ins installed on client computer before using the system. Therefore the recent web-based applications tend to 
adapt CORBA or Java based distributed infrastructure. That is free from the connectionless or stateless 
problem, and also has some advantages of distributed system technology, such as message passing, 
RPC(Remote Procedure Call), and proprietary communication protocol. The client connects to the server 
using the HTTP protocol only for the initial connection, and after the downloading the specific mobile code 
application(for example, client side application, JavaScript, Java Applet, and etc), the client use the 
proprietary protocol(non-HTTP), so it does not communicates with web server, but communicates with 
proprietary server(non-Web server). 

WALTS employed CORBA to adapt this kind of distributed infrastructure. The system is designed by HTTP 
server which takes care of user requests and responses, and CORBA-based server which performs the 
capabilities of the ITS. Also the system could be easily re-organized if we want to modify the structure later 
on [see figure 1]. In short, one of the major advantages of WALTS is that it can easily avoid the bottle-neck 
problem of CGI techniques, and also we believe that this style of architecture might be another best solution 
for building web-based client/server educational system. 



3 Basic architecture of the system 

The basic architecture of WALTS is designed by typical ITS structure primarily, including expert module, 
the student modeler module, and the instructional planning module. 



3.1 The expert module 

The expert module of the system consists of the object-oriented knowledge base, and the problem solver. 
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Figure 1 The main architecture of the WALTS 

Object Oriented-based knowledge base. First, we employed the frame knowledge representation 
techniques for the main knowledge base. Because the domain knowledge does not require any complex 
causal relationships, but rather it is consists of simple C language concepts. The object-oriented approach 
make it easy to modify the data type, can reduce the knowledge base reference by having slot values as 
member data, and can provide more flexibility for updating or manipulating tutoring strategy [5]. 

In this system we designed a frame with several meaningful slots, and each frame does not have to have the 
same number of slots, since the inference engine can get all the necessary informations due to the 
inheritance feature of the system. The 'type' slot can possess a concept, example, or quiz. The 'source* slot 
points to its superior frames. The 'Pfame’ and ‘CFrame* slot is necessary when we need to show the related 
nodes in linked list structure. The 'reference' slot may contain all the necessary frame names that are related 
to the current frame. This kind of slot structure is very common in every frame structure, and also important 
in object-oriented structure, because each frame can have common attributes and can generate an object of 
having its own attribute. Also, the system allows an abstract class, which plays the backbone of the system, 
and supports a hierarchical structure, and the definition of the method can be done only in the lower class 
[figure 2]. 



Frame Variable Declaration Quiz 

[Source] Chapter 1-3- 1-1 
[Type] Quiz 

[Title] Variable declaration Quiz 

[Template] Data Type | Variable | General Grammar 

1 : Select the correct %type variable declaration 

2 :... 

[PFrame] Variable Declaration 
[CFrame] Null 

Figure2 Variable declaration quiz frame 

The Problem Solver. WALTS can generate a problem dynamically depending on the current topic. Since 
the planner knows what is being taught at the moment by generating a lesson unit, the tutor can decides 
whether it is ‘teaching concept’ or ‘show example’ or ‘quiz’. At the moment, we have only three styles of 
lesson unit. If it is a ‘teaching concept’, the planner sends the lesson unit to the user in HTML form. If it is a 
‘quiz’ type, then planner requests the problem solver to generate a question. The problem solver first creates 
a problem table by referring to the current lesson unit. The generating and solving a problem occurs at the 
same time, and the solver stores the correct answer. And then, it presents the generated questions to the user 
in appropriate HTML form through the HTML generator. This method can provide different styles of 
questions for different users even though they are accessing the same lesson unit, which can be another 
advantage of WALTS. Since the column name of the table is object’s name, the planner can reply to the 
user’s request, such as hint or help, by referencing this table. 
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Figure3 Creation of a quiz for ‘variable declaration* 



The strategy of asking user for answering quiz is multiple choices. So that we need to generate problems 
along with the appropriate multiple choice answers also. For instance, let us think about a simple quiz about 
asking user ‘a data type*. A typical ‘data type* is consists of three parts, for example, ‘int x ;*.The ‘int* is a 
data type integer, ‘x* is a user-defined variable name, and ‘;* is needed for ending a sentence in C language. 
We are trying to generate this simple data type declaration statement sentence as follows. First, the data type 
‘template* slot consists of three parts as in [Figure 3]. Then we can generate eight different answers as in 
[Figure 5], since each one part of a statement can be correct or incorrect. And we can select some of them 
randomly including correct answer; the numbered answers are selected ones in the figure. And also we can 
obtain designated unit object’s content as in [Figure 4]. The generated correct answer is stored in memory, 
and then later it is compared with the user’s answer. For example, if the user selected number 2 as in [figure 
5], we can analyze that the user does not know about reserved word. And the planner needs to revise the 
lesson plan to correct the misconceptions by giving special messages, such as hint or help, and then the 
planner re-organizes the lesson plan including ‘reserved word* lesson unit. The [figure 6] shows a sample 
session of solving a generated quiz. 
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Figure4 Data type unit frame 
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Figures Table for possible answers for data type quiz 



3.2 The Instructional Planner 

The most web-based educational systems built upon hypertext, which is hard to make hyperlink in every 
HTML pages, and also needs to have carefully designed navigation strategy[2]. And also all the lesson 
contents are built as HTML pages in advance, and must reside in the system physically. We believe that 
generating a lesson plan dynamically, for each individual user, is more efficient than the above approaches. 
Therefore, we adapted the traditional ITS instructional planning mechanism into the system. The 
instructional planning of the WALTS can be further divided into 3 steps, a curriculum planning, a lesson 
planning, and a delivery planning. The curriculum planning of WALTS generates a curriculum in tree 
structure; the curriculum planner extracts information from the knowledge base and creates a curriculum 
hierarchically in the order of prerequisites. Then the lesson planning sets up the lesson sequence within a 
single lesson unit. The role of delivery planning is limited to presenting the selected lesson content to the 
user. 
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Figure6 An example of solving a generated quiz 



Curriculum planning. The purpose of the curriculum planning is to provide a curriculum to the user, in 
other words, to provide an individualized optimal learning path to the user[l]. The generated curriculum is 
in the form of a tree structure. It is constructed by creating an initial node by referencing the value of the 
attributes in the lesson unit slot, and further expands the structure in the order of the way the student must 
learn, which will be accessed as linked list structure. The lesson unit of the system is organized according to 
some basic rule, such as the student must leam prerequisite concept first and the move to the next topic. So 
the curriculum is set up in the form of hierarchical and linear sequence. 



Lesson Planning. The lesson planner generates a lesson plan by referencing the curriculum and the 
student model. The information from the student model shows the results from single lesson unit and based 
on this record, the planner sets up appropriate lesson plan for the student. When the student selects other 
learning path on purpose before the current lesson plan is finished, the system must decide what to do next, 
such as whether to store the current lesson plan and execute the user’s request, and then resume the current 
plan or destroy the current plan and re -plan the whole sequence all over again. In that sense, WALTS uses re- 
planning strategy when the user wants to quit the current topic, and move to another learning path. Another 
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case of re-planning occurs when the student made an error on the selected quiz lesson unit. If the student 
made a mistake on this, the current lesson plan is suspended, and another new lesson plan is created to 
correct the student’s error. After the remediation process is finished, the suspended plan will be resumed. 



Delivery Planning. The lesson unit has been generated by lesson planner and needs to be delivered to the 
user. The possible delivery tactic in this domain could be "present concept, show example, give exercise, and 
etc”. Of course if the system allows mixed-initiative control, the delivery planning needs to be more 
sophisticated in order to handle all the user request or questions. The delivery planning part of the WALTS is 
made of simple structure, and will be enhanced further in the next research. 



The HTML generator. The very distinctive feature of the system is the HTML generator. This feature can 
be regarded as the interface part of the system. When the delivery planner decides the immediate unit lesson, 
the content of the lesson is converted into HTML form by the HTML generator. The HTML generator 
generates HTML pages according to the HTML2.0 protocol and inserts “next” or “previous” button in order 
to navigate adaptive learning path. But if the lesson unit contains some applet, the system directly searches 
the physical location and sends the URL to the student’s browser without consulting HTML Generator. The 
[figure 7] describes the HTML generator sends two different results to two different users, since their 
learning background is different. 







Student 1 
lnformatioi 



Figure7 The HTML generator 



3.3 The student modeler 



The strategy for building the student modeler is the simple overlay, which simply reflects user’s learning 
process about cunent topic. And this should be enhanced by including the buggy information later on. But 
an important enhancement is that the student modeler of WALTS can avoid the unnecessary network traffic. 
For instance, if the system maintains the student model in the server-side, then whenever the user accesses 
the system the server needs to update the user’s student model in the server. This may cause another 
bottleneck problem, and the most CGI-based systems still have this problem. Our approach on the student 
modeler is as follows. The server-side student modeler creates a table, and keeps all the necessary 
administrative informations on the server-side, such as initial student’s ID, password, e-mail address, the 
access time[figure 8], which can be used for various administrator purposes. And the information regarding 
the student’s learning process is stored in the student model[figure9], which is created in the client-side 
machine for each individual user whenever they logged on. The student model has several parameters that 
reflect the student’s learning history, and each parameter has unique meanings. For example, the 
‘HelpCount’, means how many times the user has been helped, and ‘HintCount’ means how many times the 
user has requested hints, and they can be updated only when the ‘unit lesson’ is quiz. The ‘ReferenceCount’ 
means the user is weak at the current unit lesson since the specific lesson has been accessed more often than 
other frames. The ‘LessonLevel’ stores information about how the level of the current topic, and the 
‘LessonType’ means whether the current unit lesson is concept, example, or quiz, and so on. 
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Figure8 The Server-side student modeler table 




Figure9 The student model 



4 Conclusion 

We have designed and implemented a web-based ITS, WALTS, which is a learning C programming 
language tutor aiming for the first year computer science students. The main goal of this paper is, first, the 
adaptation of the existing ITS techniques into the web platform. Therefore, we have designed and 
implemented the system based on the major ITS architecture, and this brings us several advantages over 
traditional HTML-based educational systems. First, the main knowledge base is created as an object- 
oriented concept, which can provide more flexibility for manipulating frame objects and tutoring strategy 
also. Second, we have generated a quiz dynamically by the problem solver and also can solve the problem. 
Third, we designed a student modeler that can avoid the network traffic in the minimal, by having the 
modeler in the server-side, and creates an individual student model in the client-side. Fourth, the 
instructional planner can generate an instructional plan dynamically, and this is another advancement of 
building web-based ITS, since the current web-based ITS research shows further work on this subject. 
Additional issue of the paper is that we designed the system as the distributed infrastructure using CORBA 
as backbone of the system. This structure solves the bottleneck problem of previous CGI dependent systems, 
and also gives some benefits of better performance and also gives flexibility in the case of further 
enhancement of the system. 
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